Evaluation of a multimodal interaction concept in virtual worlds
نویسندگان
چکیده
In the presented paper we address the issue of multimodal interaction concept in virtual worlds. The topics of multimodal interaction and virtual worlds are presented in general. We present and apply a multimodal approach consisting of voice commands, motion and gesture based modalities to a Second Life virtual world. Detailed description of key pilot system elements and architecture is given. The proposed multimodal approach was tested both objectively and subjectively by the evaluation study. The study results show that the addition of voice and alternative navigation modalities significantly improve overall user experience.
منابع مشابه
Interaction Locus: a Multimodal Approach for the Structuring of Virtual Spaces
This paper presents an approach for the structuring of virtual places. The interaction locus concept (a coordinated summa of visual, audio and textual components) is introduced for improving the navigation in virtual spaces, a key issue for the definition of the inte raction paradigm. The interaction locus concept has been applied to a number of case studies in the realm of cultural heritage, s...
متن کاملA Phong-Based Concept for 3D-Audio Generation
Intelligent virtual objects gain more and more significance in the development of virtual worlds. Although this concept has high potential in generating all kinds of multimodal output, so far it is mostly used to enrich graphical properties. This paper proposes a framework, in which objects, enriched with information about their sound properties, are being processed to generate virtual sound so...
متن کاملArchitecture for Collaborative Learning Activities in Hybrid Learning Environments
3D virtual worlds are recognized as collaborative learning environments. However, the underlying technology is not sufficiently mature and the virtual worlds look cartoonish, unlinked to reality. Thus, it is important to enrich them with elements from the real world to enhance student engagement in learning activities. Our approach is to build learning environments where participants can either...
متن کاملGlobal Lab: an Interaction, Simulation, and Experimentation Platform based on ”Second Life” and ”OpenSimulator”
In this paper we describe a novel platform for virtual worlds called Global Lab. Through example applications, we demonstrate the capabilities of this platform for ubiquitous simulation and experimentation for sensor-based systems. Furthermore, with multimedia information representation and support for bi-directional communication real and virtual devices are connected in the example of a parti...
متن کامل